Automatic number plate recognition (ANPR; see also other names below) is a mass surveillance method that uses optical character recognition on images to read vehicle registration plates. They can use existing closed-circuit television or road-rule enforcement cameras, or ones specifically designed for the task. They are used by various police forces and as a method of electronic toll collection on pay-per-use roads and cataloging the movements of traffic or individuals.
ANPR can be used to store the images captured by the cameras as well as the text from the license plate, with some configurable to store a photograph of the driver. Systems commonly use infrared lighting to allow the camera to take the picture at any time of the day.[1][2] ANPR technology tends to be region-specific, owing to plate variation from place to place.
Concerns about these systems have centered on privacy fears of government tracking citizens' movements, misidentification, high error rates, and increased government spending.
ANPR is sometimes known by various other terms:
The ANPR was invented in 1976 at the Police Scientific Development Branch in the UK. Prototype systems were working by 1979, and contracts were let to produce industrial systems, first at EMI Electronics, and then at Computer Recognition Systems (CRS) in Wokingham, UK. Early trial systems were deployed on the A1 road and at the Dartford Tunnel. The first arrest through detection of a stolen car was made in 1981.
The software aspect of the system runs on standard home computer hardware and can be linked to other applications or databases. It first uses a series of image manipulation techniques to detect, normalize and enhance the image of the number plate, and then optical character recognition (OCR) to extract the alphanumerics of the license plate. ANPR systems are generally deployed in one of two basic approaches: one allows for the entire process to be performed at the lane location in real-time, and the other transmits all the images from many lanes to a remote computer location and performs the OCR process there at some later point in time. When done at the lane site, the information captured of the plate alphanumeric, date-time, lane identification, and any other information that is required is completed in somewhere around 250 milliseconds. This information, now small data packets, can easily be transmitted to some remote computer for further processing if necessary, or stored at the lane for later retrieval. In the other arrangement, there are typically large numbers of PCs used in a server farm to handle high workloads, such as those found in the London congestion charge project. Often in such systems, there is a requirement to forward images to the remote server, and this can require larger bandwidth transmission media.
ANPR uses optical character recognition (OCR) on images taken by cameras. When Dutch vehicle registration plates switched to a different style in 2002, one of the changes made was to the font, introducing small gaps in some letters (such as P and R) to make them more distinct and therefore more legible to such systems. Some license plate arrangements use variations in font sizes and positioning—ANPR systems must be able to cope with such differences in order to be truly effective. More complicated systems can cope with international variants, though many programs are individually tailored to each country.
The cameras used can include existing road-rule enforcement or closed-circuit television cameras, as well as mobile units, which are usually attached to vehicles. Some systems use infrared cameras to take a clearer image of the plates.[3][4][5][6][7] [8] [9][10][11][12]
Recent advances in technology have taken automatic number plate recognition (ANPR) systems from fixed applications to mobile ones. Scaled-down components at more cost-effective price points have led to a record number of deployments by law enforcement agencies around the world. Smaller cameras with the ability to read license plates at high speeds, along with smaller, more durable processors that fit in the trunks of police vehicles, allow law enforcement officers to patrol daily with the benefit of license plate reading in real time, when they can interdict immediately.
Despite their effectiveness, there are noteworthy challenges related with mobile ANPRs. One of the biggest is that the processor and the cameras must work fast enough to accommodate relative speeds of more than 100 mph (160 km/h), a likely scenario in the case of oncoming traffic. This equipment must also be very efficient since the power source is the vehicle battery, and equipment must be small to minimize the space it requires.
Relative speed is only one issue that affects the camera's ability to actually read a license plate. Algorithms must be able to compensate for all the variables that can affect the ANPR's ability to produce an accurate read, such as time of day, weather and angles between the cameras and the license plates. A system's illumination wavelengths can also have a direct impact on the resolution and accuracy of a read in these conditions.
Installing ANPR cameras on law enforcement vehicles requires careful consideration of the juxtaposition of the cameras to the license plates they are to read. Using the right number of cameras and positioning them accurately for optimal results can prove challenging, given the various missions and environments at hand. Highway patrol requires forward-looking cameras that span multiple lanes and are able to read license plates at very high speeds. City patrol needs shorter range, lower focal length cameras for capturing plates on parked cars. Parking lots with perpendicularly parked cars often require a specialized camera with a very short focal length. Most technically advanced systems are flexible and can be configured with a number of cameras ranging from one to four which can easily be repositioned as needed. States with rear-only license plates have an additional challenge since a forward-looking camera is ineffective with incoming traffic. In this case one camera may be turned backwards.
There are six primary algorithms that the software requires for identifying a license plate:
The complexity of each of these subsections of the program determines the accuracy of the system. During the third phase (normalization), some systems use edge detection techniques to increase the picture difference between the letters and the plate backing. A median filter may also be used to reduce the visual noise on the image.
There are a number of possible difficulties that the software must be able to cope with. These include:
While some of these problems can be corrected within the software, it is primarily left to the hardware side of the system to work out solutions to these difficulties. Increasing the height of the camera may avoid problems with objects (such as other vehicles) obscuring the plate but introduces and increases other problems, such as the adjusting for the increased skew of the plate.
On some cars, tow bars may obscure one or two characters of the license plate. Bikes on bike racks can also obscure the number plate, though in some countries and jurisdictions, such as Victoria, Australia, "bike plates" are supposed to be fitted. Some small-scale systems allow for some errors in the license plate. When used for giving specific vehicles access to a barricaded area, the decision may be made to have an acceptable error rate of one character. This is because the likelihood of an unauthorized car having such a similar license plate is seen as quite small. However, this level of inaccuracy would not be acceptable in most applications of an ANPR system.
At the front end of any ANPR system is the imaging hardware which captures the image of the license plates. The initial image capture forms a critically important part of the ANPR system which, in accordance to the Garbage In, Garbage Out principle of computing, will often determine the overall performance.
License plate capture is typically performed by specialized cameras designed specifically for the task. Factors which pose difficulty for license plate imaging cameras include speed of the vehicles being recorded, varying ambient lighting conditions, headlight glare and harsh environmental conditions. Most dedicated license plate capture cameras will incorporate infrared illumination in order to solve the problems of lighting and plate reflectivity.
Many countries now use license plates that are retroreflective.[13] This returns the light back to the source and thus improves the contrast of the image. In some countries, the characters on the plate are not reflective, giving a high level of contrast with the reflective background in any lighting conditions. A camera that makes use of active infrared imaging (with a normal colour filter over the lens and an infrared illuminator next to it) benefits greatly from this as the infrared waves are reflected back from the plate. This is only possible on dedicated ANPR cameras, however, and so cameras used for other purposes must rely more heavily on the software capabilities. Further, when a full-colour image is required as well as use of the ANPR-retrieved details it is necessary to have one infrared-enabled camera and one normal (colour) camera working together.
To avoid blurring it is ideal to have the shutter speed of a dedicated camera set to 1/1000 of a second. Because the car is moving, slower shutter speeds could result in an image which is too blurred to read using the OCR software, especially if the camera is much higher up than the vehicle. In slow-moving traffic, or when the camera is at a lower level and the vehicle is at an angle approaching the camera, the shutter speed does not need to be so fast. Shutter speeds of 1/500 of a second can cope with traffic moving up to 40 mph (64 km/h) and 1/250 of a second up to 5 mph (8 km/h). License plate capture cameras can now produce usable images from vehicles traveling at 120 mph (190 km/h).
To maximize the chances of effective license plate capture, installers should carefully consider the positioning of the camera relative to the target capture area. Exceeding threshold angles of incidence between camera lens and license plate will greatly reduce the probability of obtaining usable images due to distortion. Manufacturers have developed tools to help eliminate errors from the physical installation of license plate capture cameras
Vehicle owners have used a variety of techniques in an attempt to evade ANPR systems and road-rule enforcement cameras in general. One method increases the reflective properties of the lettering and makes it more likely that the system will be unable to locate the plate or produce a high enough level of contrast to be able to read it. This is typically done by using a plate cover or a spray, though claims regarding the effectiveness of the latter are disputed. In most jurisdictions, the covers are illegal and covered under existing laws, while in most countries there is no law to disallow the use of the sprays.[14] Other users have attempted to smear their license plate with dirt or utilize covers to mask the plate.
Novelty frames around Texas license plates were made illegal in Texas on 1 September 2003 by Texas Senate Bill 439 because they caused problems with ANPR devices. That law made it a Class C misdemeanor (punishable by a fine of up to US $200), or Class B (punishable by a fine of up to US $2,000 and 180 days in jail) if it can be proven that the owner did it to deliberately obscure their plates.[15] The law was later clarified in 2007 to allow Novelty frames.
If an ANPR system cannot read the plate it can flag the image for attention, with the human operators looking to see if they are able to identify the alphanumerics.
In order to avoid surveillance or penalty charges, there has been an upsurge in car cloning. This is usually achieved by copying registration plates from another car of a similar model and age. This can be difficult to detect, especially as cloners may change the registration plates and travel behavior to hinder investigations.
Other possible options include IR emitting LEDs around the license plate which would serve to "blind" cameras.
On 11 March 2008, the Federal Constitutional Court of Germany ruled that some areas of the laws permitting the use of automated number plate recognition systems in Germany violated the right to privacy.[16] More specifically, the court found that the retention of any sort of information (i.e. Number Plate data) which wasn't for any pre-destined use (e.g. for use tracking suspected terrorists or for enforcement of speeding laws) was in violation of German Law. These systems were provided by Jenoptik Robot GmbH called TraffiCapture <http://www.jenoptik.com/Internet_EN_TraffiCapture>
The project of system integration «OLLI TECHNOLOGY» and Department of State Traffic Inspection (STI) of the Ministry of Internal Affairs of Ukraine continue experiment on introduction of a modern technical complex which is capable to search stolen cars, drivers deprived of driving license and other problem cars in online mode. The Ukrainian complex "Video control" working by a principle of video fixing of the car with recognition of license plates with check under data base.
Several Hungarian auxiliary police units use a system called MATRIX POLICE in cooperation with the police. It consists of a portable computer equipped with a webcam that scans the stolen car database using automatic number plate recognition. The system is installed on the dashboard of selected patrol vehicles (PDA based handheld versions also exist) and is mainly used to control the license plate of parking cars. As the Auxiliary Police doesn't have the authority to order moving vehicles to stop, If a stolen car is found, the formal police is informed.
The UK has an extensive (ANPR) automatic number plate recognition CCTV network. Effectively, the police and security services track all car movements around the country and are able to track any car in close to real time. Vehicle movements are stored for 5 years in the National ANPR Data Center to be analyzed for intelligence and to be used as evidence.
In 1997 a system of one hundred ANPR cameras, codenamed GLUTTON, was installed to feed into the automated British Military Intelligence Systems in Northern Ireland. Further cameras were also installed on the British mainland, including unspecified ports on the east and west coasts.
In the United States, ANPR systems are more commonly referred to as ALPR (Automatic License Plate Reader/Recognition) technology, due to differences in language (i.e. "number plates" are referred to as "license plates" in American English)
Jurisdictions in the U.S. have stated a number of reasons for ALPR surveillance cameras, ranging from locating drivers with suspended licenses or no insurance, to finding stolen vehicles and "Amber Alerts". With funding from the insurance lobby, Oklahoma introduced ALPR with the promise of eliminating uninsured motorists, by integrating it with its existing PikePass hybrid RFID/OCR toll collection system, and unmarked police vehicles used for intelligence gathering. [17] [18] Oklahoma replaced all license tags with ALPR-compatible plates in 2009. In Arizona, insurance companies are helping to fund the purchase of ALPR systems for their local law enforcement agencies to aid in the recovery of stolen vehicles.
Other ALPR uses include parking enforcement, and revenue collection from individuals who are delinquent on city or state taxes or fines.
A recent initiative by New York State deployed ALPR systems to catch car thieves by tracing suspect plates back to forged documents. Albany, NY police also scan vehicles in their parking lot to check visitors for warrants.[19]
In addition to the real-time processing of license plate numbers, ALPR systems in the US collect (and indefinitely store) data from each license plate capture. Images, dates, times and GPS coordinates can be stockpiled and can help place a suspect at a scene, aid in witness identification, pattern recognition or the tracking of individuals. Such data can be used to create specialized databases that can be shared among departments or individuals (such as insurers, banks or auto recovery "repo-men".[20]) Specialized databases can also be used to compile personal information on individuals such as journalists [21] suspected gang members, employees of a business, patrons of a bar, etc., and be shared by E-mail or portable flash media.
From time to time, states will make significant changes in their license plate protocol that will affect OCR accuracy. They may add a character or add a new license plate design. ALPR systems must adapt to these changes quickly in order to be effective. For the most part, however, the North American design will be based on a variation of the "Zurich Extra Condensed" font.[22]
Another challenge with ALPR systems is that some states have the same license plate protocol. For example more than one state may use three letters followed by four numbers. So each time the ALPR systems alarms, it is the user’s responsibility to make sure that the plate which caused the alarm matches the state associated with the license plate listed on the in-car computer.
ANPR is used for speed limit enforcement in Austria,[23] Dubai (UAE), Italy, The Netherlands,[24] Spain,[25] and the UK.[26]
This works by tracking vehicles' travel time between two fixed points, and calculating the average speed. These cameras are claimed to have an advantage over traditional speed cameras in maintaining steady legal speeds over extended distances, rather than encouraging heavy braking on approach to specific camera locations and subsequent acceleration back to illegal speeds.[27]
Average speed cameras (trajectcontrole) are in place in the Netherlands since 2002. As of July 2009, 12 such cameras are operating, mostly in the west of the country and along the A12.[28] Some of these are divided in several “sections” to allow for cars leaving and entering the motorway.
A first experimental system was tested on a short stretch of the A2 in 1997 and was deemed a big success by the police, reducing overspeeding to 0.66%, compared to 5 to 6% when regular speed cameras were used at the same location.[29] The first permanent average speed cameras were installed on the A13 in 2002, shortly after the speed limit was reduced to 80 km/h to limit noise and air pollution in the area.[30] In 2007, average speed cameras resulted in 1.7 million fines for overspeeding out of a total of 9.7 millions. According to the Dutch attorney general, the average number of violation of the speed limits on motorway sections equipped with average speed cameras is between 1 and 2%, compared to 10 to 15% elsewhere.[31]
One of the most notable stretches of average speed cameras in the UK is found on the A77 road in Scotland, with 32 miles (51 km) being monitored between Glasgow and Ayr.[32] In 2006 it was confirmed that speeding tickets could potentially be avoided from the 'SPECS' cameras by changing lanes and the RAC Foundation feared that people may play "Russian Roulette" changing from one lane to another to lessen their odds of being caught.[26] However, in 2007 the system was upgraded for multi-lane use and in 2008 the manufacturer described the "myth" as “categorically untrue”.[33] There exists evidence that implementation of systems such as SPECS has a considerable effect on the volume of drivers travelling at excessive speeds; on the strech of road mentioned above (A77 Between Glasgow and Ayr) there has been noted a "huge drop" in speeding violations since the introduction of a SPECS system.[32]
In Italian Highways has developed a monitoring system named Tutor covering more than 1244 km (2007). Further extensions will add 900 km before the end of 2008. The Tutor system is also able to intercept cars while changing lanes.
Many cities and districts have developed traffic control systems to help monitor the movement and flow of vehicles around the road network. This had typically involved looking at historical data, estimates, observations and statistics such as:
CCTV cameras can be used to help traffic control centres by giving them live data, allowing for traffic management decisions to be made in real-time. By using ANPR on this footage it is possible to monitor the travel of individual vehicles, automatically providing information about the speed and flow of various routes. These details can highlight problem areas as and when they occur and helps the centre to make informed incident management decisions.
Some counties of the United Kingdom have worked with Siemens Traffic to develop traffic monitoring systems for their own control centres and for the public.[34] Projects such as Hampshire County Council's ROMANSE provide an interactive and real-time web site showing details about traffic in the city. The site shows information about car parks, ongoing road works, special events and footage taken from CCTV cameras. ANPR systems can be used to provide average driving times along particular routes, giving drivers the ability to choose which one to take. ROMANSE also allows travellers to see the current situation using a mobile device with an Internet connection (such as WAP, GPRS or 3G), thus allowing them to be alerted to any problems that are ahead.
The UK company Trafficmaster has used ANPR since 1998 to estimate average traffic speeds on non-motorway roads without the results being skewed by local fluctuations caused by traffic lights and similar. The company now operates a network of over 4000 ANPR cameras, but claims that only the four most central digits are identified, and no numberplate data is retained.[35] [36] [37]
Ontario's 407 ETR highway uses a combination of ANPR and radio transponders to toll vehicles entering and exiting the road. Radio antennas are located at each junction and detect the transponders, logging the unique identity of each vehicle in much the same way as the ANPR system does. Without ANPR as a second system it would not be possible to monitor all the traffic. Drivers who opt to rent a transponder for C$2.55 per month are not charged the "Video Toll Charge" of C$3.60 for using the road, with heavy vehicles (those with a gross weight of over 5,000 kg) being required to use one. Using either system, users of the highway are notified of the usage charges by post.
There are numerous other electronic toll collection networks which use this combination of Radio frequency identification and ANPR. These include:
See also: List of electronic toll collection systems
The London congestion charge is an example of a system that charges motorists entering a payment area. Transport for London (TfL) uses ANPR systems and charges motorists a daily fee of £10 paid before 10pm if they enter, leave or move around within the congestion charge zone between 7 a.m. and 6:00 p.m., Monday to Friday. A reduced fee of £9 is paid by vehicle owners who sign up for the automatic deduction scheme. Fines for traveling within the zone without paying the charge are £60 per infraction if paid before the deadline, doubling to £120 per infraction thereafter.
There are currently 1,500 cameras, which use Automatic Number Plate Recognition (ANPR) technology.[38] There are also a number of mobile camera units which may be deployed anywhere in the zone.
It is estimated that around 98% of vehicles moving within the zone are caught on camera. The video streams are transmitted to a data centre located in central London where the ANPR software deduces the registration plate of the vehicle. A second data centre provides a backup location for image data.
Both front and back number plates are being captured, on vehicles going both in and out – this gives up to four chances to capture the number plates of a vehicle entering and exiting the zone. This list is then compared with a list of cars whose owners/operators have paid to enter the zone – those that have not paid are fined. The registered owner of such a vehicle is looked up in a database provided by the DVLA.[39]
In Stockholm, Sweden, ANPR is used for the congestion tax, owners of cars driving into or out of the inner city must pay a charge, depending on the time of the day.
Several companies and agencies use ANPR systems. These include Vehicle and Operator Services Agency (VOSA), Police Information Technology Organisation (PITO) and Transport for London.
The introduction of ANPR systems has led to fears of misidentification and the furthering of 1984-style surveillance.[40] In the United States, some such as Gregg Easterbrook oppose what they call "machines that issue speeding tickets and red-light tickets" as the beginning of a slippery slope towards an automated justice system:
Systems with a simple review step can eliminate this downside. Then the machine reports data – date, time, speed measurement and license plate – a good system records a photo of the event – so a person presented with the data is making an accusation. You will get a copy of the data when you go to court.
Similar criticisms have been raised in other countries. Easterbrook also argues that this technology is employed to maximize revenue for the state, rather than to promote safety.[41] The electronic surveillance system produces tickets which in the US are often in excess of $100, and are virtually impossible for a citizen to contest in court without the help of an attorney. The revenues generated by these machines are shared generously with the private corporation that builds and operates them, creating a strong incentive to tweak the system to generate as many tickets as possible.
Older systems had been notably unreliable; in the UK this has been known to lead to charges being made incorrectly with the vehicle owner having to pay £10 in order to be issued with proof (or not) of the offense. Improvements in technology have drastically decreased error rates, but false accusations are still frequent enough to be a problem.
Perhaps the best known incident involving the abuse of an ANPR database in North America is the case of Edmonton Sun reporter Kerry Diotte in 2004. Diotte wrote an article critical of Edmonton police use of traffic cameras for revenue enhancement, and in retaliation was added to an ANPR database of "high-risk drivers" in an attempt to monitor his habits and create an opportunity to arrest him.[42][43] The police chief and several officers were fired as a result, and The Office of the Privacy Commissioner of Canada expressed public concern over the "growing police use of technology to spy on motorists." [44]
Other concerns include the storage of information that could be used to identify people and store details about their driving habits and daily life, contravening the Data Protection Act along with similar legislation (see personally identifiable information). The laws in the UK are strict for any system that uses CCTV footage and can identify individuals.[45][46][47][48][49][50][51][52][53]
Also of concern is the safety of the data once it is mined, following the discovery of police surveillance records lost in a gutter.[54] [55]
There is also a case in the UK for saying that use of ANPR cameras is against the law under the Regulation of Investigatory Powers Act 2000.[56] The breach exists, some say, in the fact that ANPR is used to monitor the activities of law-abiding citizens and treats everyone like the suspected criminals intended to be surveyed under the act. The police themselves have been known to refer to the system of ANPR as a "24/7 traffic movement database" which is a diversion from its intended purpose of identifying vehicles involved in criminal activities.[57]
ANPR systems may also be used for/by:
It is not uncommon to read claims of Automatic Number Plate Recognition read rates in excess of 98%. The experience of system operators is that overall read rates for license plates are 90% to 94% in ideal conditions with excellent modern systems. In some older systems overall performance rates are rumoured to be between 60% and 80%. ANPR is a developing technology which is coming of age and functional applications are expanding on a steady basis. Although there has been a significant improvement in recent years in the performance of ANPR systems, how operators can assess and monitor ANPR/LPR systems has not advanced as much.[63]